f-Divergence Estimation and Two-Sample Homogeneity Test Under Semiparametric Density-Ratio Models

نویسندگان

  • Takafumi Kanamori
  • Taiji Suzuki
  • Masashi Sugiyama
چکیده

A density ratio is defined by the ratio of two probability densities. We study the inference problem of density ratios and apply a semi-parametric density-ratio estimator to the two-sample homogeneity test. In the proposed test procedure, the f -divergence between two probability densities is estimated using a density-ratio estimator. The f -divergence estimator is then exploited for the two-sample homogeneity test. We derive an optimal estimator of f -divergence in the sense of the asymptotic variance in a semiparametric setting, and provide a statistic for two-sample homogeneity test based on the optimal estimator. We prove that the proposed test dominates the existing empirical likelihood score test. Through numerical studies, we illustrate the adequacy of the asymptotic theory for finite-sample inference.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On Empirical Likelihood in Semiparametric Two- Sample Density Ratio Models

We consider estimation and test problems for some semiparametric two-sample density ratio models. The profile empirical likelihood (EL) poses an irregularity problem under the null hypothesis that the laws of the two samples are equal. We show that a “dual” form of the profile EL is well defined even under the null hypothesis. A statistical test, based on the dual form of the EL ratio statistic...

متن کامل

Testing Homogeneity in a Semiparametric Two-Sample Problem

We study a two-sample homogeneity testing problem, in which one sample comes from a populationwith density f x and the other is from amixture populationwithmixture density 1−λ f x λg x . This problem arises naturally from many statistical applications such as test for partial differential gene expression inmicroarray study or genetic studies for genemutation. Under the semiparametric assumption...

متن کامل

Relative Density-Ratio Estimation for Robust Distribution Comparison

Divergence estimators based on direct approximation of density ratios without going through separate approximation of numerator and denominator densities have been successfully applied to machine learning tasks that involve distribution comparison such as outlier detection, transfer learning, and two-sample homogeneity test. However, since density-ratio functions often possess high fluctuation,...

متن کامل

Bayesian Semiparametric GARCH Models

This paper aims to investigate a Bayesian sampling approach to parameter estimation in the semiparametric GARCH model with an unknown conditional error density, which we approximate by a mixture of Gaussian densities centered at individual errors and scaled by a common standard deviation. This mixture density has the form of a kernel density estimator of the errors with its bandwidth being the ...

متن کامل

Generalized Ridge Regression Estimator in Semiparametric Regression Models

In the context of ridge regression, the estimation of ridge (shrinkage) parameter plays an important role in analyzing data. Many efforts have been put to develop skills and methods of computing shrinkage estimators for different full-parametric ridge regression approaches, using eigenvalues. However, the estimation of shrinkage parameter is neglected for semiparametric regression models. The m...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • IEEE Trans. Information Theory

دوره 58  شماره 

صفحات  -

تاریخ انتشار 2012